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ABSTRACT . The familiar suboptlmal regulator design approach Is recast as a 
constrained optimization problem and Incorporated In a CAD package where 
both design objective and constraints are quadratic cost functions. This 
formulation permits the separate consideration of, for example, model- 
following errors, sensitivity measures and control energy as objectives to 
be minimized or limits -to be observed. Efficient techniques for computing 
the Interrelated cost functions and their gradients are utilized In 
conjunction with a nonlinear programming algorithm. The effectiveness of 
the approach and the degree of Insight into the problem which It affords Is 
Illustrated In a helicopter regulation design example. 

Keywords . Computer-aided design; control engineering computer 
applications; multivariable control systems; nonlinear programming; optimal 
control; optimization. 


INTRODUCTION 

Since the interest in control system 
optimization generated by the linear 
quadratic regulator (LQR) approach there 
have been a number of quite separate 
developments. Some workers followed the 
pattern set hy Levine and Athens (1970) who 
Imposed constraints on controller structure 
but retained the scalar quadratic cost 
function adopted in LQR design. Various 
features can bo Incorporated within this 
context such as sensitivity reduction and 
model-following and an efficient solution 
technique typically employs an unconstrained 
gradient minimization algorithm (see Fleming 
1979). Computationally this is an 
attractive approach but from the design 
point of view it is dogged by the 
difficulty of using a scalar quadratic 
measure to describe all the desired facets 
of system performance. 

Another line of attack was prompted by 
Zakian's Method of Inequalities (Zakian, 
1973) In which system constraints and 
specifications are represented by a set of 
simultaneous algebraic Inequalities. 
Control engineers found this approach 
attractive because the problem description 
could Include such basic control design 
parameters as overshoot, damping, settling 
time, etc. Polak and Mayr.e advanced this 
idea by posing semi-infinite programming 
problems In which design objectives are 
realized by minimizing a function subject to 
A sot of inequalities where these objectives 
can be expressed as Infinite dimensional 
constraints (Mayne and co-workers, 1982). 


Such problems require special mathematical' 
programming algorithms to handle the" 
infinite dimensional constraints and, 
sometimes, nondif f erentiable functions. 


The method described here strikes a 
compromise between these two approaches la 
that the quadratic measures of the 
suboptlmal linear regulator approach aro 
retained but the problem la recast as a 
constrained minimization problem lu which 
the constraints may represent bounds on 
control energy, model-following errors, 
sensitivity, etc. The minimizing controller 
gain matrix Is obtained efficiently using 
readily available software tools and a CAD 
package has been mounted on a 32-bit 
minicomputer. What appears at first sight 
to be a relatively straightforward extension 
of suboptlmal regulator design yields a 
numerical solution technique which, from the 
designer's viewpoint, is much more efficient 
than the original design approach and 
provides results which reveal useful 
insights into the design problem. The 
method Is exercised within the CAD context 
by means of a design example on helicopter 
regulation in which the identification of 
active constraints at the minimum plays a 
leading role In understanding the nature of 
the problem. 


PROBLEM STATEMENT 

For clarity a simplified statement of the 
problem follows : 

Given the linear time-invariant plant 
description 
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x - A x + B n , x (0) “ * 0 » 
-p P~P P~P ~P T 10 

2p “ Vp* 

end feedback control law 


u p - K^, (3) 

find the control, Up(t), which minimizes the 
quadratic cost function 

" “ _ 

J o ‘ l “ [ x p Q <^p dt ’ (4> 


where 7) 0 - Q 0 + cjK T R 0 KC p , 
subject to the Inequality constraints 


FORMULATION OF THE NONLINEAR 
PROGRAMMING PROBLEM 

If we let k represent the minimizing 
variables, i.e. the variable elements of 
gain matrix, K, then we have the nonlinear 
programming problem: 

minimize . 
w.r.t. k O’ 

subject to the Inequality constraints 
J i “ Z 1 < °* i“l,2,***q. 

The cost functions, J t , 1-0, l,»**,q, Eqs, 
(4) and (5), can be computed from 


J i < V 1 “ 

where Jj Is a quadratic cost function of 
the form 



J i " tr ( P l X o)» 1-0,1, 


where X n » x x and 

0 ~P0~ P 0 

Liapunov matrix equation 


satisfies the 


P t A + a'Pj - - 0 ± , i"0, 1, ••• ,q, (7) 


and Q t - Q t + cJk^KC . 

The Inequality bounds, z^, are designer- 
specified and the weighting matrices, 

1 « 0,1,..., q, which are usually diagonal, 
are also selected by the designer. 


For the full problem formulation, as 
Incorporated in the CAD package, the plant 
state vector, Xp, may be augmented by a 
state compensator vector, x c , a trajectory 
sensitivity vector, x 8 > and a model state 
vector, x m to accommodate a dynamic 
compensator option for the controller and 
the inclusion of sensitivity reduction and 
model-following torma in the cost functions 
(see Fleming, 1979). 


where A - A p + B p KC p , (see Eqs. (1) - (3)). 

Gradient information may be obtained from 
the gradient matrices 

8J t /9K - 2(B p P 1 +R 1 KC p )AC p , i-0,l,"*,q (8) 

where A satisfies the Liapunov matrix 
equation 

AA T + AA - -X Q . (9) 

For the caae where Initial conditions are 
not known matrix Xq may ha modified ao 
that either tho expeetd values, the average 
values or the worst-case values t! x in 

P 0 

Jj, 1-0, 1 , • • • ,q are measured (sae 
Fleming, 1979). 


One application, for example, might seek a 
controller gain matrix, K, to achieve a 
certain degree of model-following within 
some control energy constraints, l.e.. 


minimize 
w.r.t. K 

subject to 


OO 


/ U dt < z. , 1—1 , 2, • • • ,m, 

0 P 1 1 

where y represents the desired model 

output response. This example is typical of 
one which would be solved using the 
straightforward ouboptlmal linear regulator 
approach by successive minimization of . 


0O 

j - 1 { V^Vv^*4 R PT> ,dt ’ 

where the designer strives to find tho 
appropriate choice of Q p and R p to 
satisfy the control energy constraints. 
Thus what was previously solved in an 
approximate way in a number of unconstrained 
minimizations is now solvod in a single 
•constrained minimization. 


There are a variety of constrained 
optimization algorithms employing gradient 
information which will solve this problem. 
In the implementation (Vanderplaats, 1973) 
of Zoutendijk's Method of Feasible 
Directions (Zoutendijk, 1960) which was 
used, the algorithm initially finds a 
feasible point and the proceeds by 
iteratively searching along feasible 
directions, employing the conjugate 
direction method of Fletcher and Reeves 
(1964) if no constraints arc violated. At 
each iteration gradient information is 
required only for the active or violated 
constraints. 


IMPLEMENTATION OF THE METHOD 

To compute the objective function, Eq. (4) 
and the constraint functions, Eq. (5), 
together with their associated gradients, 
Eq. (8), matrices P^, 1-0,1, ••*,q and A 
must be obtained from the set of Liapunov 
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matrix equations (7) and (9) at each 

iteration of the minimization algorithm; 
also the set of equations (7) must be solved 
several times within each iteration to 
compute the objective and constraint 
functions at each step of the linear 
search. The method of Bartels and Stewart 
(1972), generally accepted as the most 
efficient Liapunov matrix equation solver, 
is a transformation method which reduces 
A, Eq. (7), to its real Schur form and then 
obtains the solution by solving a set of low 
order (<4) linear equations. It is well 
suited for this application where only one 
Schur reduction of A per estimate of K 
Is necessary for the solution of the 
(q+2) equations (7) and (9). The solution 
of these equations is further speeded up by 
exploiting certain structural and sparseneas 
properties of and Xq. 


The adoption of the Bartels-Stcwart method 
has the added advantage that system 
eigenvalues may be determined for each new 
estimate, of K from the diagonal and 
principal subdiagonal elements of the real 
Schur form of A at little extra 

computational cost. Monitoring of. 

eigenvalues is necessary since Eq. (7) is 
only valid for stable values of X. 

Although the problem is such that, in 
general, the minimization routine will tend 
to generate stabilizing values of K, 

computational traps have been set to inhibit 
unstable excursions of K. Should such an 
excursion take place the line search step is 
repeatedly halved until a stable value of 
K la reached. Clearly the minimization 
routine also requirea that the initial 
estimate of K stabilize A, and, when the 
open-loop plant is unstable, Bhould it be 
necessary, the program will search for a 
stabilizing value of K using a steepest 
descent technique similar to that of 

Koenigsberg and Frederick (1970). 


The CAD program operates in conversational 
mode permitting easy modification of design 
parameters Q^, R^, and z^ as well as 
specification of the gain parameters in 
matrix K to be optimized. Solution times 
are dependent on the number of constraints 
but typically the numerical minimization 
takes 2-4 times longer to compute than the 
correaponding suboptimal regulator 

approach. However this method is much more 
efficient in achieving the design goal 
thereby reducing design time as well as 
affording the designer Increased 
understanding of the problem. 


DESIGN EXAMPLE - HELICOPTER 
REGULATION 

The plant describing helicopter longitudinal 
dynamics (Michael and Farrar, 1973) has four 
states and two controllers! 


*p - [w x ,w |! ,e,6] T , Up - [“i»u 2 ] t . 

Prior to this design a standard LQR design 
had been carried out and a satisfactory 
result obtained which gave good regulation 
for U x and U z (forward and vertical 
velocities) observing control magnitude 
constraints on uj and U 2 (longitudinal 
cyclic pitch and main, rotor collective 
pitch). These controllers utilize feedback 
from all four plant states, i.e. 

U “ K C pt X, and the resulting responses are 

characterized by 

x ■ (A +B K )x A A x_ , 

— p p p opt'— p — nr~m 

where A^ is defined to be the "model” 
matrix. Since feedback from w x and 
W E requires airspeed sensors which are 
undesirable, the objective here is to 
examine whether similar regulation responses 
can be achieved without sensing m x and 
P E and without violating control magnitude 
constraints . 


He therefore wlBh to minimize an objective 
function which measures the error between 
the new plant response and the model 
response! 

00 

J o - 1 (v^ tQ o ( V*J dt » 

where Q 0 - diag (1,1, 0,0), 
subject to the constraints 

J t < z t , i-1,2, 

where 

00 

J. ■ / u. dt, z.-4.06, 

1 0 1 * 

■ / u^dt, z 2 «6.57 

and x - [1 1 1 1] T . 

~P0 

The values of z^ and tj correspond to 
the values of Jj and J 2 obtained for 
11 " K opt x with the above initial 

conditions. The constraints therefore place 
limits on control energy and indirectly 
limit control mangltudea. 


Various controllers structures were 
considered! 


Controller 


Controller 


Controller 
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TABLE 1 Design Results for Various Controller Configurations 


Controller Gain Matrix K Jq Active Constrainta max|uj(t)| max|u 2 (OI 


LQR 

f-2.56 0.29 0.50 
0.38 1.98 -0.26 

0.24 ' 
-0.06 

0 

J l» J 2 

1.60 

1.66 

(2.0*) 

1 


0. 16 0.14" 

-0.25 0.22 


0.072 

J 2 

1.07 

1.60 

2 


r 0 . 18 "] 
L-°- 25 J 


0.35 

J 2 

1.17 

1.60 

3 


0.32 -0.24 
-0.06 -0.30 
1 -1.37 


0.10 


1.13 

1.47 

4 


Qo.25 0.30 

1.50 

— 

1.18 

— 

5 


no feasible 
solution 


60.2 

J 2 - 426.3 

— 

8.43 


Controller 4: 
Controller 5i 



Design results are tabulated above. Note 
that for the dynamic compensator. Controller 
3, in order to obtain a minimal parameter 
form element Vt 3 j is nonvarying and set to 
unity. 


Excellent model-following is achieved with 
Controller 1, pitch angle and pitch rate 
feedback, although there is soma 

deterioration when Controller 2, pitch anglo 
feedback alone, is used. This situation is 
remedied by using a first-order dynamic 
compensator together with pitch angle 
feedback, Controller 3. Graphical results. 
Figs. 1 and 2, illustrate the model- 
following capabilities of these three 
controllers. Controllers 4 and 5 explore 
the possibility of using uj or U 2 
alone. Poor model-following is realized by 
Controller 4 and it was found to be 
impossible to stabilize the system using 
Controller 5 within the constraint bounds. 
The algorithm failed to find a feasible 
solution for this case in ten iterations: 
the results at this point are presented. 


The last two columns of Table 1 and Fig. 3 
indicate that the control energy constraints 
are effective in keeping the control 
magnitudes within bounds. The LQR 
controller has an initial value of 2.04 
(bracketed in the table) which swiftly falls 
from this level. It is assumed, therefore, 
that the level U 2 (t) “ - 1.66 is the more 
important magnitude to he observed Bince 
control effort is around this level for a 
Significant period. Figure 3 illu 8 trates 


how well this bound is observed. If, 
however, U 2 magnitudes up to 2.04 can be 
•accommodated then constraint 2 should be 
relaxed by increasing xj by an appropriate 
factor. 


From the results we learn that the magnitude 
of U 2 is the limiting component which 
prevents further improvement in model- 
following capability ' with Controller 
Structures 1 and 2. With the dynamic 
compensator structure, Controller 3, itB 
best performance is achieved wl thin the 
constraints. Controller Structures 4 and 5 
have proved themnolvcs incapable of 
producing good results. 


The implications, then, are clear: 

i) Both controls uj and U 2 Ota 
necessary, 

ii) It is desirable to feedback 
8 and 8 however, if 8 i 8 unavailable, 
satisfactory results can be achieved with a 
first-order compensator, 

lii) A relaxation of the magnitude 
constraint on U 2 will lend to improved 
results. 


It is in the nature of the problem 
formulation that designs for each controller 
structure were obtained in one optimization 
process enabling the designer to effectively 
experiment with different controllers 
structures. Further, using tho gain-fixing 
facility of the program, system integrity 
can be taken into account in the manner of 
Fleming (1081). 


• CONCLUDING REMARKS 

A new optimization approach baaed on the 
linear-quadratic formulation haa been 
proposed for control system design. 


{ 
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Application to a Linear-Quadratic Formulation 


Exploiting the mathematical tractabllity of 
the formulation an efficient CAT) program has 
evolved for , solving linear regulator 
problems. The use of constraint functions 
In the problem description frees the 
designer to a large extent from the chore of 
weighting matrix selection and presents 
additional information concerning the nature 
of the design problem. 

Additional features may be incorporated 
within the program. For example, the 
inclusion of aide constraints on gain values 
will be particularly useful in dynamic 
— compensator design and the handling of large 
parameter variations may be implemented in a 
similar way to that of Vinkler and co- 
workers (1979). Also, since plant 

elgenvaluee and eigenvectors are easily 
obtained from the Schur form of A arlBlng 
from the approach these may also be 
incorporated in the design objective and 
constraints. 


Although the package performs well current 
work ie directed at further improving its 
effectiveness by identifying the boat 
optimization algorithm in terms of apead of 
convergence and robustness for this 
particular nonlinear programming problem. 


ACKNOWLEDGEMENT 

The author is grateful to Nancy Shoemaker, 
ICASE, for her computational assistance and 
to A. A. Schy and D. P. Giesy, NASA Langley 
Research Center, for several valuable 
discussions relating to this work. 


Research reported in this paper was 
supported by the National Aeronautics and 
Space Administration under Contract No. 
NAS1-17070 while the author was in residence 
at the Institute for Computer Applications 
in Science snd Engineering, NASA Langley 
Research Center, Hampton, VA 23665, 





Peter Fleming 



Fig. 2 Vertical velocity responses, V z , illustrating model-following capabilitieo of a) 
Controller 1, b) Controller 2 and c) Controller 3. 
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